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This  study  is  one  of  a series  prepared  for  tho  Neuropsychiatry  Branch, 
Professional  Division,  Buioau  of  "odicine  and  Surpsry,  Dopartneat.  of  navy, 
under  Office  of  Naval  Research  c«atract  N7  onr  434  with  Tulaao  University. 

Tho  opinions  expressed  heroin  are  those  of  the  authors  and  do  not  nocossaxily 
reflect  the  oplnioos  of  the  sponsoring  ogoncy,  tho  Departoent  of  Navy  or  the 

oplnlcas  of  the  cooperating  agency,  the  U.  S Marine  Corps. 
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A portion  of  this  monograph  was  reported  at  the  1952  cnnunl  meeting 
of  the  American  Psychological  Association . 

Any  consideration  of  the  Rorschach  as  a roooaich  instrument  should  in- 
clude a Joint  consideratleai  of  th©  conceived  use  of  the  instrjcient  and  the 
user's  COTceptioo  of  the  nteasurements  obtained  from  the  Instrumont.  Tho 
Theory  of  Rorschach  scoring  categories  ind  tho  function  of  the  test  in  the 
research  program  are  each  Integral  parts  of  this  consideration  Thus,  it 
becomes  Important  at  th©  outset  to  specify  whether  tho  Rorschach  is  to  be 
used  In  describing  or  nahlng  predictions  about  individuals  or  about  groups. 


A. 


Th©  present  report  purportE  to  ur.^  the  EovGciii?ch  in  the  description  of 
Individuals  and  groups  of  individuals.  Tho  n'^r.otiioti c approach,  often 
disparaged  for  EorscJiach  research  methodology . ly  for  the  pios^nt  tfch 
altogotbe.  appropriate. 

It  Is  not  tho  purpose  of  the  present  ‘oport  to  inply  that  a particular 
group  exhibits  any  particular  personality  nanifestai ions . The  nethodology 
of  the  Rorschach  laost  useful  in  tho  recognition  of  an  individual's  person- 
ality structure,  os  revoaled  by  the  test.  Is  dopondont  upon  the  intor- 
reiations  of  th®  Rorschach  Indicators  within  a given  protocol.  Hoofy.fer, 
this  does  not  moon  that  uoru^itlve  data  such  as  boro  presented  are  unrelated 
to  tho  interpretation  of  on  individual  Rorschach  protocol.  On  the  contrary, 
it  is  strongly  urged  that  such  nonaativo  luforiaatloa  provides,  oither 
Inpllcitly  or  oxplicltly,  the  very  framework  necessary  in  the  evaluation 
of  tho  Individual  protocol.  Purt boranore , this  framework  is  particularly 
useful  and  important  when  owe  is  coacemed  with  the  Horseboeb  rocord  of  an 
individual  from  a special  subpopulatloa  or  with  a record  obtained  using 
some  modification  in  the  Qdainistratlou  or  scoring  procedures. 

In  the  present  report,  the  tost  administration  and  scoring  procedures 
are  first  described.  Following  this  is  a description  of  the  subiK'^pulations 
together  with  tbelr  Borscbacb  norms.  The  Important  problra  of  reliability 
is  then  considered  and  conclusions  r«>gardlng  administration  procedures  are 
presented . 

Testing  procedures . Projected  Images  of  standaid  Rorschach  plates  were 
presented  on  a S'  x 7’  beaded  screen  to  groups  of  subjects  (Ss)  assembled  in 
a room  with  a seating  arrangeaent  provided  to  r.Iu..alze  the  distortion  of  two 
factors:  perspective  foreshortening,  and,  the  visual  angle  subtended  by  the 


projected  lEiQge.  Tfce  ariiiJe  ^ubtendotl  when  viOTod  on  ihe  sayvnn.  v/;xr  approJ.i- 
riately  the  aaae  0=3  the-  aubtonded  in  tji  individaal  Fo’':;fbac:i  tost  ehea  i;Jk 
plate  is  held  approrlnatG^ly  22  Inchon  itez  the  eye  cf.  tie 

The  E^ysicol  orrangetiantG  £03*  testing  shoyn  in  FlgiiiTG  I y;  05 1 do  I’or 
seating  of  a foa^iisuiF  cf  30  sen. 

Wh<m  the  Ss  were  sealed,  the  following  instruct i-’jna  i end  v,o  tlies" 

"3u  a few  •aS.auten  the  room  will  bo  dariesied  and  ysu  "'ill 
be  shewn  ten  Ink  blots  ca  the  screoa,  aae  at  a tiae.  Ycu 
will  rrito  down  the-  things  sijggasted  to  you  by  tba  ink 
blots.  Thar®  will  be  enough  light  to  do  this  ciud  yon 
don’t  need  to  »*=oiTy  about  olther  spoiling  or  hano'vjriting . 

The  respciises  will  bo  wilttcu  In  'ho  i.  >!ilet  whicli  you 
have.  You  will  start  wilting  on  page  three  in  the 
second  colionn . Place  «.  Ronan  Duaii?'.*al  card  In 

tho  center  of.  that  page  on  the  cop  line  . At  the  crasple- 
tion  of  the  showing  of  each  card,  skip  docn  a f.cns  spaces 
end  write  down  the  mmibf-r  of  the  nezt  card.  If  you  fill 
page  three,  turn  to  pagC'  five,  then  to  page  seven,  and 
so  on,  using  onl?  one  side  of  each  page.  12  50M  fill 
the  booklet,  raise  your  batvci  and  another  one  will  be 
passed  out  to  you. 

Thl?  test  is  called  the  Rorschach  Teat.  Everyone  go*s 
about  resp'Wding  to  it  in  his  own  way,  so  there  are  very 
few  rules  're  can  give  you.  Eacb  Ink  blot  will  be  thres'n 
on  tho  scrota  for  threo  minutes.  You  are  to  write  down 
rrhat  you  ctui  moles  out  ob  the  card,  what  It  looks  like  to 
you,  or  what  resemblances  you  may  find  in  It.  There  arc- 
no  right  or  wrong  anawexB,  because  no  two  people  f:eo  the 
same  things  in  the  blot,  "or  are  they  necesssrily  re- 
minded of  the  same  objects.  For  each  new  Idea  you  g'jt 
from  eacb  blot,  start  w.titing  what  you  sec  on  a now  line, 
numbering  your  lines  on  the  left  band  side  of  tho  coltam. 

After  we  begin,  no  questions  will  be  answeeod  f.rooi  tho 
floor,  but  if  you  have  any  difficulty,  please  raise  your 
hand  and  one  of  us  will  come  to  your  choir.  Absolute 
quiet  is  nticessary  thxotjighout  the  test.  Are  there  <355 'y 
questions?' 

Routine  questions  »©;•=«  .=s.ns»ered;  then  the  rtKssi  wus  darkeciid  tsnd  e;*t;b  pluto 
was  projected  on  a glass  beaded  screen. wade?  constant,  «tC'at.yoll£d  «;ondl<:io;'i 
for  three  minutes  in  th>*i  upright  position.  An  opaque  projettor,  ^»~J.C8S2 
atade  by  C.  Deseler  Ctwpaay,  was  used. 
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Each  S wrote  his  Rs  to  each  plate  in  a spaciai  boohlet  provided  for 


this  pxirpono.  This  was  dono  diu*ing  tho  tiiso  the  card  nas  being  projected, 
with  additional  tiae  allowed  after  each  projection  for  coapleting  the  Ss 
to  tho  card . 

Controlled  illinalnatioa  in  the  rooci  was  maintained  just  high  enough 
for  comfortable  recording  of  the  Rs  by  the  S.  Soft  pencils  vrere  used  to 
zaalto  it  cosier  for  the  Ss  to  see  what  they  had  written  in  the  diialy  lit 
rocM.  The  illmination  incident  upon  tho  screen,  with  projector  oa,  was 
ono  candle  power  as  saoasm’ed  on  a standard  General  Electric  Solcnlum 
fhotoaoter,  model  DW  40,  with  hood  open. 

After  tho  ten  plates  had  boon  pronented,  tho  Ss  were  asked  If  any  of 
them  hod  previously  taken  tho  test,  and  any  Instances  of  prior  ejqsosure  to 
tho  ink  blots  were  noted  ou  tho  cover  of  tho  response  booklet  for  tho  use 
of  tho  psychologist  diirirg  tho  inquiry  period.  Following  the  complotlon  of 
tho  Rb  to  the  tost  plates,  the  booklets  were  collected.  An  individual  in- 
quiry was  then  conducted  with  each  man  by  a skilled  Rorschach  administrator 
in  tho  nenner  characteristic  of  tho  inquiry  interview  ns  used  undor  condi- 
tions of  individual  adnlnistraticxa  of  the  Rorschach  tost.  The  tost  was 
scored  by  tho  psychologist  who  conductod  the  intei’view. 

Table  I sunnariies  the  experience  background  of  tho  psychologists  who 
scored  the  protocols.  It  may  bo  noted  that  tho  personnel  who  conducted  the 
individual  inquiries  and  scored  tho  tost  had  an  average  of  11  yeax's  experi- 
ence 08  clinical  psychologists,  and  an  average  of  7.4  years  experiocce  in 
Rorschach  odmlnistratlOT . 
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Table  1 


EXPERliJTJCE  BACESF.OWJD  OF  RORSCHACH  AD13IH2STRATCKS 
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Psychologist 

Yoais  of  Paid 
Espoi’ionce  as 
Clinical  Psy- 
chologist 
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Sn  Rorschach  Ad- 
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Boch 
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10.75 

7.38 
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The  sub  populations  and  their  norma . One  thousand  men  from  four  different 
asBesBBcnt  programs  comprised  the  Uarlne  subpopiilatlon.  Three  hundred  seventy- 
four  Navy  Officers  tested  in  throe  different  assessment  periods  while 
attending  a Navy  graduate  school  comprised  the  Navy  sulipopulation.  The 
billets  to  which  the  men  In  those  two  groups  all  had  elected  were  distinctly 
different.  Furthermore,  biographical  Information  obtained  from  the  Ss 
in  the  two  groups  reveals  rather  marked  differences.  The  Mn.  candidate 
In  the  tiarlne  group  was  22^  yoars  of  age,  spent  most  of  his  life  in  a city 
with  a population  between  25,000  and  100,000,  bad  a protestant  religious 
background,  and  had  completed  two  years  of  college.  All  of  tho  Marine  Ss 
bad  at  least  six  months  prior  military  service  and  /5  per  cent  had  <5ver  28 
months  prior  service.  All  of  the  Marine  Ss  were  candidates  for  officer 
commissions  and  70  per  cent  were  noncocmissloned  officers. 

The  Kdn.  candidate  In  the  Navy  group  was  24  years  of  age,  spent  most 
of  his  life  in  a city  with  a population  of  over  100,000,  bad  a protestant 
religious  background,  and  bod  completed  four  years  of  college.  The  Na"^y  group 
showed  a bl-modal  distribution  for  previous  military  service;  one  mode  was 
at  3 Bontbs,  one  at  99  montha  or  over.  The  range  of  ranV-  held  in  the  Navy 
group  was  fro;:  Ensign  to  Commander , with  the  Udn  falling  at  Lt . (Jg) . Tables 
2 and  3 present  the  Marine  and  Navy  frequency  norms  for  the  major  scoring 
categories  used  and  the  percentile  scorings  corrospcndlng  to  those  norms. 

A comparison  of  the  distributions  for  the  two  groups  reveals  a different 
"normal”  pattern  of  test  score  distribution.  Vhilo  the  N of  the  Nevy  sub- 
population  is  smaller  than  that  in  the  Marine  group  it  is  still  sufficiently 
large  to  Justify  the  assumption  of  stability  of  the  norm  data.  The  differ- 
ences between  the  distributions  for  the  two  groups  cannot  be  attributed  to 
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F+%  scored  after  Beck,  for  Havy  Group. 
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ThiiJ  I'OEult  ii'.'Jica'.crj  that  iatorprctationa 
"noraal  superioir  acialt  "orcclsach  pattoi'a”  j^uri  bo  r.ndc  v/itliSn  the  content 
of  tha  Koras  lor  tbo  aubpopulatioii  to  which  the  S balonsn,  if  the  full 
sigaif icanca  of  tho  RorGcliaeh  ECoviiiK  oategorioG  is  to  bo  obtained  iron 
tho  interprotatiov*.  of  the  protocol. 


A conparieon  of  the  distribution  for  tho  various  catocorics  obtained 
through  tho  group  ndmlnistratlcn  with  those  obtained  fron  the  traditional 
individual  admin t strati  on  of  the  iior.schach  cards  suggosts  that  tho  results 
obtained  bj-  the-  group  procedure  do  not  differ  greatly  frora  those  usually' 
reported  for  steilar  populations  under  conditions  of  individual  adniaistra- 
tlon.  Bock,  ot  al  (2)  report  for  their  Gpiogol  snnple  a L!  total  Es  of 
32.65  with  a SO  of  17. S3.,  Tho  23  to'zcx  Co  for  onr  I'iarine  sataplo  was  27.5? 
aad  for  our  Ilavy  soraple  was  31. 2G.  ‘.'fi-on  one  considers  that  there  was 
scao  positive  skownoss  in  tho  diatributioa  of  our  R scores,  it  is  suggosted 
that  the  tota2.  mcabor  of  Rs  obtained  aro  ossontinlly  tho  some  for  the  two 
types  of  edministrations . Too  chief  variation  observed  between  our  norms 
and  Beck's  norms  was  in  the  location  Rs.  In  both  our  samples  there  woro 
a greater  nts’ibo'^  and  peroontrrso  of  17  K.s . Tho  gi’eator  frequency  of  the  V 
responses  were  made,  of  coui'se,  at  tho  ospense  of  tho  othor  dotorniaant 
rasponses  i.  c. , D,  .Od,  and  dd  fCs.  A second  category  in  whisk  a deviation 
was  obtained  was  that  of  the  FS.  In  the  Karine  e^oup  administration,  tho 
K of  tho  distribution  of  F%'s  was  45.05.  In  the  Spicgol  sample,  tho  23  of 
tho  F%'s  wag  vO.  Ctoo  othor  p<^iut  should  be  noted  coricoming  tha  scoring 
categorios  proscatod.  The  F+%  calculated  for  tho  Elarino  group  was  strange 
to  most  of  tho  clinicians  and,  os  will  be  sbcKm  in  the  results  on  rollablllty, 
much  confusion  resulted  from  this  scoring  of  P+%  with  a I'osultlng  lowering 
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of  rel Inblll ty - Tho  norms  cbtainod  for  scoring  thon  aro  not  very 

•Ttcanfngful . 

•If  one  asBurees  that  the  R pattern  obtained  by  exposttre  to  tho  rtorcchach 
cards  Involves  a constant,  systematic  source  of  error  variance  in  the  use 
of  the  group  and  Individual  typo  administrations,  then  one  can  genorallxe 
tho  findings  concornieg  tho  necessity  of  developing  norms  for  distinctive 
subpopulationj;  to  all  types  of  Rorschach  testing  1.  e.,  tho  nocosslty  for 
developing  nonss  for  subpopulations  in  individual  Rorschach  testing,  is  just 
as  great  as  the  doaonstr.atod  necessity  of  such  norns  for  uso  with  the  group 
presentation  of  the  Ink  blot  cards. 

One  other  hypothesis  Is  suggested  in  the  nomative  data  presented  In 
Tobies  2 and  3.  The  H nusnber  of  Re  for  the  1,000  Marine  Officer  candidates 
xras  27.52.  nils  Is  higlier  then  those  repiortod  by  Guilford  for  his  Air 
Force  population.  Guilford  (S)  reported  a V.  of  20  Rs  under  Individual  ad- 
ministration. The  total  number  of  Rs  In  our  study  aro  rojaparnblo  to  Lord's 
(16)  result  with  college  students  under  conditions  of  "positive  individual 
administration."  The  Mdn,  number  is  also  blghor  than  that  reported  by  Sells 
(20)  for  the  SAil  group  ink  blot  test  which  he  developed  and  standardized  on 
U.  S.  Air  Force  cadets  and  officers.  In  view  of  .Lord's  and  the  Air  Force's 
results  shooing  that  the  protocols  obtained  under  conditions  of  individual 
sdoinlstratlon  are  influenced  significantly  by  tho  administrators,  plus 
the  results  reported  herein  that  show  that  at  least  on  avor.oge  or  above 
average  number  of  Rs  ore  obtained  with  the  use  of  tho  Navy  Group  Method, 
the  following  hypothesis  is  suggested;  For  research  purposes,  the  Ravy 
group  technique  results  in  a store  rollahle  and  possibly  a more  valid  protocol 
than  can  be  obtained  tinder  conditions  of  Individual  administration.  This 
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hype  the:’.’ 3 thot  a wove  vaJ.tci  prot04~o'l  •r'>3ultE  <inder  fjroup  odalnistration  Is 
Biiggost&ii  by  tbs  fact  that  the  protocols  thus  obtained  aro  less  Anfl’oonced 

O 

or  disturbed  by  internctlon  between  adcinistrator  and  exaiaiaeo.'’ 

Kollability  of  Knvjr  Group  Uothed.  Invosticatlonc  of  the  reliability 
of  the  Rorschach  testing  tocliulqne  aay  conveniently  bo  classifiod  under 
ome  of  three  headings  depending  on  whethor  the  study  Is  concerned  with  the 
roproductiblllty  of;  Cl)  the  subject’s  rcspocsos  to  the  cards;  (2)  the 
scoring  nade  of  the  rosponse  protocol;  <3)  the  interpretations  made  fresa 
the  scored  protocols.  Unfortun.atoly , tho  Inter protatlons  to  bo  made  of 
soao  studies  ai's  ofton  e<tUitocal  bocati'^o  cf  tho  fact  that  s<r,'aral  variatolos 
have  been  concoaitontly  operating.  Syst.QS’atic  consldoi'otion  of  the  number 
of  indepcadont  variables  which  could  be  manipulated  In  Rorschach-typo  Ink 
blot  rolio’alllty  studies  reveals  that  there  are  at  least  thirteen  such 
variables,  'fliear  variobieu,  and  citation  to  reports  whore  they  have  been 
studied,  are  os  follcws: 

1.  Physical  character  of  sets  of  card.s  presented;  (10,  21) 

2.  Individual  and  group  administration;  (B) 

3.  CliOTigod  envlroniaontal  conditions  for  card  px’esen cation ; (8,  13,  IG,  23) 

4.  Sequence  of  card  presentation;  (IV) 

5.  Ronogenolty — betorogcuelty  of  status  poaitiooB  of  Su ; (1,  5) 

6.  Set  of  Ss  for  teat  taisk;  <S,  13) 

V.  Coyatancy — variefclltty  in  S3  psyc’nodynjjslc  structure;  <12,  16,  21,  23) 

Ji.  Adataictrator  dlf fcroacBB ; <Q,  1C) 

9.  Method  for  csslgning  scoriag  syiabol  to  K;  (3,  10,  11,  14) 

10.  Scorer  s;sill  In  assigning  symbol  to  R;  (18) 

11.  fnterprofvtltMi  cf  acoros;  (3,  14) 

T.  ■ 

A report  lo  in  preporstlou  of  * study  designed  to  test  this  hyivothasis 
The  results  of  that  study  offer  positive  support  to  the  hypothesis. 


12.  I’iCHOJict'  or  ftbrsoM^^c-  c<".  11  luciu.ti.y;  C5,  ■?> 

1,3.  I^rcqvJfiijcy  ol  caitl  proEcatp-tioa ; (16) 

This  rrono.^aph  reports  oii  Rorsci-.jich  scoi'.iiig  !•(.:. liability  os  iaf lucncod 
by.  (nl  dtTievont  ?.ndix*idual  isqui-vios  r.oiico.ratau  tho  Rs  niuSc  in  tlic  srao 
baste  protocol  cbtataCi'S  isador  coudiilc.os  o?  group  cujsutnirjti-atlon:  Mid  (h) 
the  .vell.aliillt'*,'  of  iTiscorlafis  oT  the  sono  protCHiol  oitlioiit  bemof  i t oT 
inquiry  iaforaatlo-a . Al  cv.f  tlxo  other  oio’-on  possible  variables  u'ere 
nonoporatlve  la  tiiis  study,  hoing  ccivtj-ollc-d  5>y  rardosiiEst.loa,  coafoi.mdlng , 
or  by  holding  tho«  constant . 

The  Rollttblllty  Frocodure . One  thousand  tSarlne  Officer  candidates 
v/ero  tcKted  in  four  different  atisesEnieat  poriods  using  the  abovo  outlined 
Navy  Croup  pTocedture . Durlni^  one  asBessnxont  ^or  i<sS , 430  aen  wero  given  t he 
test  ao  described.  Of  this  group,  ICC  rore  EGlocte«l  at  rnndora  and  oallc-d 
back  tffo  days  lalei  and  given  a cocerd  Inqu'ry  concerning  the  Rs  they  bad 
i33dc  in  the  original  protocol.  Those  cten  weie  assigned  at  randosa  to  the 
clinlc&l  psychologists  with  the  restilctlen  that  no  candidate  savr  the  sane 
psychologist  twice.  The  wi-itteu  protocola,  without  tho  first  inquiry  results 
available,  wore  given  the  different  lisycbologists  the  second  tlion  and  each 
scored  them  individually  after  conducting  a socond  inquiry.  The  data  froen 
this  100  re-scorings  were  used  fo,  the  "effect  of  differont  Individual  la- 
qulrles”  p'>rtiou  of  the  roliabllity  study.  Ono  you.-  later  53  of  the  written 
protocols  were  roscored  by  sooio  of  thc^  saia©  poychoiogists  who  did  the 
original  scoring.  These  latter  rescoi^lngs  weie  c2«icx  without  tho  use  of 
iioy  inquiry  infomntico.  Those  data  constituted  tho  "score-roscore ” portion 
of  the  reliability  study. 

The  Relisbiltty  Results . Tables  Z and  3 present  the  results  of  tho 
'sf.'orlcg  with  inquiry"  reliability  study  (in  Tablo.s  those  are  laboled 
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’’reliability  cooif  tclen . "I . a'ld  "srerc-;  or.cyi’C'’'  rollaiji  I. ! iy  stiviy.  Thc^se 

rasi'lts  G3-0  prcGont  .-a  xn  tv.rao  o.i  reliability  coefficients  .for  l.li>  various 
categories.  Two  differont  waanmer;  of  i-elat3.onsh.ip  were  c-iV.oioyed . !?hoE.  the 
assuzsptlfinc  of  "coiTJal  dis-tributlou’'  iu;d  linoaj  ity  o>?  re;>rcs3ion  -.vci-c 
satisfied,  product-'.nosEcat  rorrolatlous  wore  calculatetl . WktQ-ro  eilchor  of 
these  ossuaptlons  tas  iiot  touablt?,  Moaa  squiio  concingcacy  corrolatlons  were 
calculated.  For  tha  sccring-vrith-lKqulry  results,  thirteen  of  tan  catcgor.los 
bjid  rollabillty  eool’f leicats  of  85  rr  bottex*.  ThI.'rtGcn  other  catogorieo 
had  correlations  between  .63  end  .35,  the  rouiixlnlag  one-thtrd  bad  corro3.at.ions 
ranging  from  .07  to  .53.  Ihe  ve7.iabllity  fm-  th''  ncoiins-'X'ith-- inquiry  stedy 
stood  up  fnli-ly  well  for  the  laajor  scoriug  categori.os  that  aro  in’jXirtuxiV.  for 
iudlvldtxal  test  interpret  at  ion . Seven  of  those  cntogorlcs  aad  ccef  f Icioxits 
of  .90  or  tK»tter;  fire  of  tbea  fell  within  the  range  of  fvo.u  .80  to  .89; 
three  fell  eithln  tho  range  of  .70  to  .79.  Ciily  tr<c.  c£  thee  wore  lew  — 

the  co»iff icionts  for  FC  CF,  iindlcating  sotae  confusion  cn  coneistont 
scoring  of  thoso  c.-itegorlcs ; i.  o.,  diff icuJvi.y  in  dotfirralning  whether  color 
or  form  was  the  determining  factor.  It  should  also  be  noted  that  foiu'  of 
the  reliability  coefficients  do  not  differ  signxf icnatiy  froia  zeio.  Those 
wore  F+%,  c •+  c'.  h,K  and  dd  par  cent;.  Thus,  the  norms  foi’  thosr  scoring 
categories  are  not  meaningful  and  should  be  dl-srcgarded  for  pur  pesos  of 
Icterpretst Ion . 

Tables  2 and  3 also  present  the  rfltifbtlity  coefficients  obtained  by 
correlating  the  original  scorioga  o.f  the  toot  and  the  rasc.orlng  t.one  one  year 
later.  When  the  score-rescorc  coefXl«'!ients  were  cozsp.rreti  with  the  roscoring- 
plua-lnqulry  coefficient  j it  was  found  th.xt  24  of  the  scoi  f— roscoro  coeffici- 
ents were  lowered,  13  of  thorn  were  raised,  and  2 remained  the  saiie.  It 
should  bo  noted  explicitly  that  while  the  aoims  for  the-  group  sidciinistrati.on 
of  the  Rorschach  plates  are  possibly  different  fro®  the  norma  obtained  >.®der 
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cowftitions  of  Indlvidml  adraiulstratlan,  those  differences  do  not  Influence 
the  Interpretations  aado  of  the  reliability  portions  of  this  study.  Tbot 
is,  the  conditions  and  tochnlqiies  used  for  tho  score -rescoro  and  the 
Individ tial  inquiry  plus  rescorinp  procedure  are  identical  with  those  used 
under  conditionn  of  Individual  adoinistrntton.  Therefore,  tho  results  of 
the  reliability  portions  of  this  study  can  be  generalized  to  individual 
scoring  procedures  in  addition  to  th©  group  scoring  procedures. 

A question  ciay  be  raised  concerning  63rsteaattc  shill  differoncea  which 
might  exist  emcmg  the  clinicians  uho  conducted  the  inquiries  and  scored  the 
protocols.  To  examine  tho  entent  of  these  differences,  a coTreletSonal 
analysis  was  made  for  one  Rorschach  category,  2X^. 

A total  of  21  different  pairs  of  psychologists  may  be  forjEod  Iron  the 
seven  psychologists  who  participated  In  tbo  Inquiry  study.  Due  to  the 
randomization  procedure,  only  14  different  eexobinations  of  psychologists 
net  the  criteria  of  having  each  member  of  the  pair  having  seen  at  least  four 
candidates,  and  with  the  further  restriction  that  half  of  the  individuals 
were  seen  first  by  one  member  of  the  pair  of  psycbologlsts  and  the  remaining 
half  were  seen  first  by  the  other  member  of  the  pair.  Vhen  these  criteria 
were  applied,  56  cases  were  isolated  from  the  original  100.  The  "scoring  with 
Inquiry"  correlation  for  those  56  cases  originally  was  .73,  which  was  increased 
to  .77  when  tho  variation  attributable  to  the  differences  among  pairs  of 
psychologists  was  eliminated  by  computing  squared  deviations  from  the 
individual  regression  for  each  of  the  different  coubinatious , and  pooling 
the  suos  of  squares  after  establishing  that  the  regressions  could  reasonably 
be  asauMCd  to  come  from  an  homogeneous  population.  Table  4 presents  the 
^ results  of  those  calculattone  and  demonstrates  that  the  obtained  mean  square 
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for  dlfforoncGB  anonc  ren^'csslonn  la  'ifliat.  would  bo  expected  by  ci:a'jpllng  from 
a hoEiogoiieour.  population.  Therefore , the  tu'cvajje  reci-encton  Is  tijo  best 
available  ostiaatc  of  the  population  regrcoslon  and  the  avcrtif'o  of  the 
correlation  coolf iclcnts , computed  from  the  aim  of  nquaros  and  products 
associated  with  this  avorngo  regression,  lo  free  from  the  variations  attrib- 
utable to  the  differences  In  the  combinattoijs  of  psychologists . 

The  hypothesis  Is  advanced  that  the  inquiry  plus  scoring  reliability 
coeificientfl  for  all  fjcorlng  catogorlos  would  be  raised  by  the  samo  order  of 
proportion  as  observed  with  the  £C  score — an  Incroose  of  one-sixth  of  the 
remaining  area  for  Improvomont — if  the  vpjrianeo  attributublo  to  differences 
taaoDS  particular  pairs  of  scorers  wore  eliminated . 

SCUKARY  CONCLUSIONS 

A modification  of  the  Rorschach  test  for  use  in  group  administration  was 
described.  This  procedure  permits  the  u.so  of  free  association  responses. 

Scoring  reliability  was  evaluated  from  two  approaches.  One  measure  of 
reliability  was  based  on  two  lodopondent  scorings  of  the  same  basic  protocol 
after  the  scorers  had  conducted  independent  indlTldual  Inquiries;  the  other 
was  based  on  two  Independent  scorings  of  the  original  responses,  made  to  the 
cards  without  benefit  of  Info^-iaation  obtained  through  the  Inquiry.  The  com- 
parison of  tbo  reliability  of  the  scoring  plus  Inquiry  with  more  rescoring 
Indicated  that  the  Inqtiiry  Infoinnation  resulted  in  correlations  that  were 
significantly  higher  than  those  obtained  with  the  score-roscore  data.  The 
major  scoring  categories  showod  a reasonably  satisfactory  set  of  reliability 
coefficients . 

Data  were  presented  to  indicate  that  variance  in  scorer  skill  lowers 
tbe  observed  correlations.  Data  were  alco  presented  which  Justify  the  coo- 


an  ex'aluntion  of  the  ovcrcill  scoring  results  obtp.inoa  !;■:  this  siudy 
with  the  results  obtained  by  Guilford  (8)  nnd  Lord  (IG)  led  to  the  dovolop- 
Kcnt  of  an  hypothesis  that  the  group  adnlnistration  ntcthocl  as  described 
herein,  when  used  for  rosoarch  pui'poses,  is  superior  to  the  individual 
adainistration  method  insofai-  as  basic  roliability  and  validity  is  con- 


cerned . 
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